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Analytical, experimental, and computer simulation results are given for 
the error spectrum of a delta modulator when probed by stationary, band 
limited, gaussian noise. These three complementary methods are used to 
increase our quantitative understanding of the nonlinear system with mem- 
ory. The error is conveniently split into two components: one linearly 
dependent on the input signal and one linearly independent of the input 
signal. In order to isolate these two types of errors we use two measurement 
techniques. For purposes of analysis we show that the delta modulator can 
be replaced by an equivalent linear system with additive noise at its output 
which is linearly uncorrelated with the input. The equivalent linear system 
may be approximated by using methods involving statistical linearization 
or the deterministic describing function. Alternately, the equivalent linear 
system may be obtained from computer simulation. 

I. INTRODUCTION 

l.l General Background and Broad Objectives 

Delta modulation (DM) has been known for almost two decades; 
yet, little has been published comparing experiment with theory par- 
ticularly for random inputs.f On the surface this might seem strange 
because of the apparent simplicity of the delta modulation system 
blocked out in Fig. 1(a). The waveforms depicted in Fig. 1(b) and 
the mathematical model in Fig. 1 (c) should suffice to explain how the 
system operates. The principal difficulty of the analysis is the ab- 
sence of general tools for handling random processes in nonlinear sys- 
tems with memory. From this viewpoint the simplicity of the delta 



t The first reference to delta modulation appeared in French patent literature 
(see Ref. 1) in 1946, but the first readily available description in English ap- 
peared in 1952 (sop Ref. 2). 
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modulator is deceptive. However, if we make some inroads into the 
quantitative understanding of this seemingly simple case, it may give 
us courage to go on to more complicated situations. 

In this paper we concentrate on the development and exploitation 
of analytical, experimental, and computational techniques to enhance 
our understanding of the objective performance of delta modulation. 
We do not consider the correlation of objective measures with sub- 
jective effects for applications to either voice or video; rather, our 
main aim is to correlate what is known in theory, including our own 
developments with what has been achieved experimentally. 

Renewed interest has come from at least two sources. First, differ- 
ential systems of which delta modulation is the simplest member, 
have long been known to be well suited to handling signals whose 
spectra fall off at high frequencies. 3-5 This is particularly true of 
black and white video; there is substantial interest in transmitting 
such signals digitally. Interest also has been generated by the desire 
to produce inexpensive time division switching and transmission sys- 
tems for voice. 7 In this application, delta modulation is attractive be- 
cause of its simplicity and great compatibility with the emerging in- 
tegrated circuit technology. 

1.2 Use of the Random Noise Probe 

Reasons for characterizing a delta modulator with a random noise 
probe are twofold. First, the envelope of a scanned video signal has 
a power spectral density that is close to that obtained by passing gaus- 
sian noise through an RC filter.f Therefore objective performance 
measures obtained in response to this signal bear some relationship to 
subjective performance. Second, use of the established noise-loading 
procedure for determining the spectrum of the noise in a nonlinear 
system yields a "signature" that is useful for verifying that the delta 
modulator is performing as designed. Verification of prescribed per- 
formance is an essential prelude to careful subjective testing as well 
as an absolute necessity for production control. To avoid measure- 
ment problems that result from the low spectral density of the RC 
noise source at the upper end of the band, we deal with flat band- 
limited white noise almost exclusively. 

1.3 Chronology and Summary 

At the start of our work the signal-to-noise ratios obtained by 
computer, experiment, and analysis disagreed substantially, partic- 

t We use the terms power spectral density, power spectrum, and spectrum in- 
terchangeably throughout. 
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ularly when the signal was changing more rapidly than the delta 
modulator could follow. In this region, known as the region of slope 
overload, two methods of computing slope overload noise differed 
markedly. 6,8 Reference 9 gives a reconciliation of the differences and 
the development of an analytical expression for the mean square 
value of the slope overload noise. By using the best features of the 
previous conflicting theories, an analytical result was obtained that 
yielded good agreement with computer results. 9 Granular noise, as 
computed from Van de Weg's approach, agreed with both simula- 
tion and experiments. 10 Results obtained by noise-loading experi- 
ments continued to disagree with both theory and simulation in the 
slope overload region. It quickly became apparent that the differ- 
ence resulted from the fact that this measurement procedure did not 
measure the noise as defined by theory. 

To clarify the differences it is desirable to consider the spectrum of 
the noise introduced by the delta modulator. Two definitions of noise 
are possible; the simplest is that the noise is the error, that is, the 
difference [x(t) — y(t)] between the input signal and the local out- 
put signal as defined in Fig. 1. This error is correlated statistically 
with the input signal. In other words, the error may be considered to 
be made up of two components, one linearly dependent on the input 
signal and one linearly independent of the input signal. The linearly 
dependent component may be regarded as being caused by passing 
the signal through a noise-free linear filter. 

This equivalent linear filter does not introduce noise but merely 
introduces frequency distortion, as for example in producing selective 
attenuation and phase shift, particularly for the higher frequency 
components of the signal that the delta modulator cannot follow. The 
noise component linearly independent of the signal may be viewed as 
equivalent to additive uncorrelated noise just as in the case of a non- 
feedback type of pulse code modulation quantizer. 11 When the noise 
is split up this way, the components have distinctly different subjec- 
tive effects and are thus meaningfully studied separately. In fact the 
spectrum of the uncorrelated component of the noise is measured by 
the noise-loading test pictured schematically in Fig. 2. This test 
procedure is commonly used to test transmission systems, primarily 
for nonlinear distortion, in this manner. 12 With the switch in the 
upper position, the colored gaussian noise is passed through a narrow- 
band elimination filter prior to exciting the system under test. At the 
system output, noise generated by system nonlinearities is measured 
by the bandpass filter in the receiver of the noise-loading set. This 
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Fig. 1 — Delta modulation : (a) delta modulation system, (b) waveforms, (c) 

mathematical model. 



filter passes only those frequency components eliminated from the 
input signal. This differs from the total noise as computed by analysis 
and simulation. 

Two approaches were taken to reconcile measurements with the 
paper and pencil results. First, we used a straight- forward, but tedious, 
measurement procedure called the cancellation test to measure the 
total noise as defined by theory, that is, the difference between output 
and input. The results achieved substantiated the theoretical results. 
Unfortunately the cancellation or "feed-around" technique, as dis- 
cussed in detail in Section IV, is tedious and difficult to perform ac- 
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curately. This made it necessary to rely on the more convenient noise 
loading measurements. To compare theory and experiment it became 
necessaiy to remove the correlated components of the noise as ob- 
tained from theory and simulation. It was not possible to do so for 
the purely theoretical approach, but the results of the simulation were 
modified, as described in Section III, to agree with the measurement 
made with the noise-loading technique. 

The equivalent linear filter, defined in Section 1.4, cannot be ob- 
tained analytically, but it may be determined using computer simula- 
tion. An approximate analytical method for arriving at the equivalent 
linear filter is statistical linearization to replace the quantizer (signum 
function, threshold circuit) of Fig. 1 with a "suitable" linear gain. 
This approach is discussed in Section 2.2 where comparisons are made 
of the equivalent linear filters obtained by the statistical linearization 
and simulation approaches. Most of the manipulations regarding the 
statistical linearization are relegated to Appendix A. Section 2.3 is 
concerned with harmonic analysis useful in its own right as well as 
a part of the cancellation test. The prelude to the Fourier analysis 
relevant to the sinusoidal response in the overload region is given in 
Appendix B. 

In Section III we cover the highlights of the simulation program 
with emphasis on the spectral calculations. Estimates of accuracy are 
given in Section 3.2. Section IV is devoted to a discussion of the 
techniques used for measuring the spectrum of the error. We also show 
how the delta modulator parameters are measured and discuss the 
realization of a laboratory model delta modulator. Throughout the 
paper we compare experiment with theory and simulation. In Section 
V we make some general comments about the various sets of results. 

1.4 System Definition, Terminology, and Symbols 

The following are the terms and symbols used. Our input signal 
x(t) in Fig. 1 is chosen from a stationary, zero mean, gaussian random 
process, band-limited to f b . Its correlation function is R zx (t) and cor- 
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responding spectral density S zx (w). The delta modulator is characterized 
by the step size k of the quantizer, sampling frequency /, , or normalized 
sampling frequency f,/f b = F, , and an ideal integrator with transfer 
function 1/s.f Clearly the maximum slope that the delta modulator 
can follow is kf, = x' , which corresponds to a string of one's at its out- 
put. As k approaches zero with x' fixed, the granular noise tends to zero 
and the noise primarily results from slope overload. Under these con- 
ditions it will be convenient and quite accurate to represent the delta 
modulator as a continuous feedback loop with a step size x' . We make 
this assumption in much of the analysis to follow. 

Throughout we use e{t) for the total noise, n(t) for that component 
of the noise uncorrelated with the input signal, z(t) for the unsampled 
output of the threshold circuit, and y(t) for the output of both the 
local integrator and the remote integrator (error free transmission). 
Other symbols are denned as needed. 

II. DEFINITION OF THE UNCORRELATED NOISE — AN EQUIVALENT 
LINEAR SYSTEM 

2.1 General 

In this section we define an equivalent linear system and an addi- 
tive uncorrelated noise which produce statistical behavior identical 
with that of the delta modulator up to second moments. Notice that 
any time invariant linear transformation of the input signal contained 
in the output may be considered as useful signal because, at least in 
principle, the input may be recovered by passing it through a fixed 
linear filter corresponding to the inverse linear transformation. 

Definition 1: Equivalent Linear System. We compare the output 
of the delta modulator y(t) with the output of an "equivalent linear 
system," denned by Figure 3, whose impulse response g(t) is denned 
such that the difference 

7/(0 - g(t)*x(t) ± n(t) (1) 

is uncorrelated with the input x (t) ; that is, 

RJr) = (x(t + r)n(/)) av = (x(t + r)[y(t) - g(t)*x(f)])~ = (2) 

where * denotes convolution. 

Definition 2: Additive Uncorrelated Noise. The difference n(t) 



t In Section 22 we consider the more practical case of a leaky integrator with 
transfer function l/(s + a). 
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given in equation (1), with equation (2) satisfied, is defined as the 
additive uncorrelated noise. Equation (2) is satisfied when 

RM*g(-r) = /Ur). (3) 

Taking the Fourier transforms of both sides of this equation and then 
the complex conjugates we get 

G(ju) = sm = l ~ sJv) {Re [8Jf§)] ~ j Im [SM]] ' (4) 

We remark here that the transfer function G (jw) does not have to be 
causal; that is, g(t) may be nonzero for t < 0. 

Applying the orthogonality principle we can see that g(t), thus 
found, also satisfiesf 

(W) ~ 9if)*x{t)]% v = minimum. 
Notice that from Fig. 3, we can write 

SJA = I G(ja>) | 2 alm + s nn (u)- (5) 

If the input process [a;(i)] has a spectrum S xx (<a) such that 

SJp) =0 for a) e |co - y . w » + Y } (6) 

where w is a given radian frequency and Aw a small radian frequency 
slot, then applying (5) we get 

S nn (") = SJp) for co z |c - ^ , co + ^}- (7) 

So that for the noise power in this frequency slot we will have 

The noise-loading measurement described in Section I applies the 
technique mentioned here. Thus the noise spectrum and noise power 
measured are <S„„(io) and (n a (t))„. In order to compare experiment 
and analysis we have to find G(jw) and (n 2 (t)) av . When we are slightly 
in slope overload, G(jw) is practically equal to 1 and all noise defini- 
tions so far used are equivalent. When well into slope overload, 



t Kazakov used this approach to obtain g(t) or equivalently G(ju) in equation 
(4) in I960. 13 We were unaware of his work at the time we conceived of the 
additive uncorrelated noise approach which for our purposes has real physical 
appeal. 
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Fig. 3 — Equivalent linear system. 

G (;«)) deviates markedly from unity, thus accounting for the differ- 
ences between experiment and analysis. To find G{ja>) we need the 
cross-spectrum S ux (<o) which is not presently available analytically. 
We can find S y! o(<o) using computer simulation; this is what is done 
in Section III. 

2.2 The Method of Statistical Linearization 

Even though the equivalent transfer function G{jw) cannot be 
found analytically, it may be approximated through the method of 
statistical linearization. 14 Statistical linearization can be applied to 
the corresponding continuous system (without sampling) as shown in 
Fig. 4. The study of the slope overload noise corresponds to the 
study of this feedback loop, with the nonlinear element in the forward 
path being a hard limiter with saturation levels ±tf = ±kf a . The use 
of the continuous system is not a substantial limitation since the cor- 
related component of the overall noise e(t) is conjectured to be mainly 
overload noise. 

The nonlinearity in the loop will be replaced by a linear gain K 
chosen according to criteria given in this section and in Appendix A. 
Independent of the choice of criterion, the equivalent linear system 
will have the form, 
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H(f) = A/(a + A) (9) 

or 

™ - TTJJm m 

where /„ is the corner frequency (3dB frequency) of the filter (/ = 

K/2ir) . 

In a real system, we generally have a leaky integrator whose trans- 
fer function is of the form l/(s + a) . Then it is easy to show that 

H (j) = -^2L. (ii) 



where 



">l 



H(0)=^". and U = K + a 



K + a' !c 2tt 

The variety of ways by which one can determine the equivalent 
gain K, are presented in detail in Appendix I. Let us call K x the 
equivalent gain found with the assumption that the input to the non- 
linearity is gaussian with variance o- 2 equal to the overload noise 
power. Denote by K 2 the equivalent linear gain when the gaussian 
assumption is removed. Let K 3 be the equivalent gain determined 
under the requirement that the difference between the overload error 
and the input to the linearized element be uncorrected (for t = 0) 
with the input signal. In order to compare the equivalent linear filter 
transfer functions with the computer simulation results we plot the 
magnitude | G(jto) | of the transfer function [calculated using equa- 
tion (4) and the computer generated cross-spectra] for kf 8 /fa = kF B = 
2 and 4 in Fig. 5. From these figures we find that the equivalent linear 
system may be approximated by a one-pole tranfer function with 
corner frequency, f a = 0.358 fa and 0.94 fa, respectively, and cor- 
responding dc gains (caused by the small leak in the integrators) 
H (0) = 0.89 and 0.98. The results of the comparison are summarized 
in Table I. Thus there is reasonable agreement between the equivalent 
linear system transfer function obtained from computer simulation 
and all the approximate statistical linearization methods. 

2.3 Describing Function Method 

In Appendix B a method is outlined for obtaining an equivalent 
frequency dependent complex gain for a delta modulation system with 
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Fig. 5 — Bode plot of the gain of the equivalent linear system (computer results, 

a = 0.16 ub). 



a leaky integrator, subject to a sinusoidal input of amplitude X and 
frequency co , under pure slope overload conditions. This complex gain 
is denned to be the ratio of the complex amplitude of the fundamental 
of the output to the complex amplitude of the input sinusoid. This deter- 
ministic equivalent linearization method is well known as the describing 
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function method. The corresponding magnitude of the equivalent gam 
is given as a function of "normalized" frequency (u o X o /x0 in Fig. 6 when 
the leak in the integrator goes to zero. For x'„ = kF, = 2 the 3 dB point 
(corner frequency) is at/. = 0.4 f b , which is in good agreement with the 
results in Table I. Measured values of equivalent gain shown on Fig. 
6 agree well with theoretical predictions. 

III. COMPUTER SIMULATION TECHNIQUE 

3.1 Basic Concepts 

Computer simulation provides a convenient method of studying the 
characteristics of delta modulation systems without actually building 
them. The computer can also provide accurate numerical results 
against which to compare experimental results from laboratory or 
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Fig. 6 — Harmonic response equivalent gain of a single integration AM. 
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production models. Computer simulation is a compromise between 
laboratory techniques and analytical techniques in that it is easy to 
change the program in order to study a variety of system parameters 
or to introduce defects similar to those expected in practical systems. 
On the other hand, the simulated system is an idealized abstraction 
which does not represent the practical system in full detail. 

The bl0di programming system, used for the simulation, results in 
a program which processes a sequence of samples by whatever set of 
mathematical operations may be specified by a block diagram. 15 bl0di 
flexibility allows the use of Fortran for such things as computing 
estimates of signal statistics, for which Fortran is more efficient. Fig- 
ure 7 indicates the basic philosophy: a Fortran program supervises 
the entire operation calling the various subprograms as needed. By 
structuring the simulation programs as a hierarchy of modules, 
changes in one area of the model could be effected without involving 
the entire program. The program was purposely written with exten- 
sive use of subroutines. This for example, makes it applicable to dif- 
ferential pulse code modulation (DPCM) by simply changing the 
subroutine for the quantizer. The actual programs are of interest to 
only a few people, and are not listed here. Appendix C gives a discus- 
sion of the computational formulas used to estimate correlation func- 
tions and spectra. 

3.2 Accuracy of Computer Estimates of Spectrum of Error 

In order to estimate the expected accuracy of the spectrum esti- 
mates from the computer simulation, the following example is given: 
In the simulation the estimate *S e (/c) is made on the basis of 10,000 
input samples. Here k is an integer index related to frequency, and 
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the subscript e refers to the total noise e(t). In one particular run, 
ten intermediate estimates based on 1,000 input samples each were 
made. Using the notation S e \(k) through S cl0 (k) for these we have 

sample mean = S.(fc) = tV [S tl (k) + • • • + S. l0 (k)] (12) 

m.m = * 

sample variance = var = t^j [S ti (k) — S.(k)] 2 + ••• 

+ [S. 10 (fc) -^(fc)] 2 }. (13) 
One can then show that the variance of the estimate S e (k) relative 
to fj. is estimated by 

E{[S.(k) -/*]"} =ivar. (14) 

For the cancellation technique and one particular value of k, rep- 
resenting a low frequency point in the spectrum, a numerical computa- 
tion yielded: 

(* var)> = 066 
S.(h) 

Although the result may in general depend on k, spot checks at other 
points yielded similar results. 

Assuming the estimate is a gaussian random variable with 0.066 = 
the ratio of standard deviation to mean, the result indicates that the 
estimate is within ± x /2 dB of the true mean with probability 0.9. 

Other sources that could contribute errors in the results of the simula- 
tion include: (i) random error in measurements caused by finite averaging 
time constant, estimated as ±| dB, (ii) round-off errors in computation, 
which are most significant in the region of high noise, and (iii) syste- 
matic error resulting from differences between the spectral shape of the 
simulated input and the output of the laboratory noise generator used 
in the experiments. 

IV. EXPERIMENTAL TECHNIQUES 

The extensive analytical and computer work that has been presented 
was undertaken to a large extent to gain a better understanding of an 
actual laboratory delta modulation system. 

4.1 Description of the Delta Modulator 

The delta modulator used for the measurements is a variable pa- 
rameter system in which the step size, leak, and sampling rate are 
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independently variable. Figure 8 is a block diagram of the encoder. 
The difference between the input and the local integrator output is 
amplified and presented to the threshold detector. This circuit con- 
trols the output of the pulse generator. 

The local integrator has circuit elements which can be changed to 
vary the important parameters of the system. The capacitor C con- 
trols the step size ; since the amplifier has a high input impedance, the 
resistor R L controls the leak. 

The decoder consists of a regenerator for amplitude and phase re- 
generation and a decoder integrator which is a duplicate of the local 
integrator. The system was operated at a 12.5 MHz sampling rate. 

Waveforms in a delta modulator are rather simple; nevertheless, 
some are shown in Fig. 9 to illustrate the actual operation of the 
system. Figure 9a indicates the output of the decoder and the pulse 
output of the coder when no input is presented to the system. A delta 
modulator should change state every clock period with no input; the 
photograph illustrates this. This waveform can be used to measure 
the step size. 

Figure 9b illustrates the output of the system when it is in over- 
load. The slope of the input sinusoidal signal is greater than the 
slope that the delta modulator can follow. Therefore, the output is a 
triangular wave whose slope is a measure of the normalized step size. 
An interesting feature can be seen by observing the slopes of the flat 
steps in this picture. In the lower half, they slant upward and in the 
upper half they slant downward, illustrating the leaking off of the 
capacitor voltage. 

Figure 9c illustrates the response of the delta modulator to a sine 
wave whose amplitude is below overload. The rather blurred trace 
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results because the frequency of the sine wave is not a submultiple 
of the sampling frequency. 

4.2 Noise Loading Test 

The use of the noise loading test to measure nonlinearities in a 
transmission system has been mentioned in Section 1.3. In this test, 
as shown in Fig. 2, a wideband of gaussian noise is applied to a low- 
pass filter to band limit the input to the delta modulator. With the 
switch in the upper position, a narrow band of noise can be elimi- 
nated from the input signal. Several band elimination filters are 
available to cover the input spectrum. This signal is fed into the sys- 
tem and only that band from which signal has been eliminated is 
allowed to pass to the tuned detector. With the switch in the upper 
position, only noise introduced by nonlinearities in the delta modula- 
tor and uncorrelated with the input is passed into the detector. The 
power spectrum of the uncorrelated noise component n(t) can be 
measured by changing the center frequency of the band elimination 
and bandpass filters. With the switch in the lower position, the full 
signal enters the system and the tuned detector reads signal and noise 
within the passband. 

4.3 Cancellation Technique 

To measure the total noise output, e(t), and its spectrum, the ar- 
rangement shown in Fig. 10 was set up. The signal is fed to the delta 
modulator and the output of the delta modulator and the attenuated 
and delayed input are compared, their difference being the noise in- 
troduced by the system. 

The immediate problem encountered in this technique is the ad- 
justment of the variable attenuator and the delay to cancel the signal 
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component at the output of the delta modulator. The delay is not 
the same for all frequencies and will have more of an effect at high 
rather than low frequencies. A sine-wave input whose amplitude was 
less than that required to overload the system was used to correctly 
null the system, making the equivalent gain unity. The frequency was 
chosen as high as conveniently possible (within the signal band) so 
that the effects of delay could be observed on the nulling procedure. 
Attenuation and delay were adjusted to produce a null at the input 
frequency at the tuned detector. Then the noise source was used to 
replace the sine wave and the output noise measured as a function of 
frequency by the tuned detector. The gain and delay should be ad- 
justed at each frequency where the noise spectrum is measured. The 
rather broad null, particularly at the lower frequencies, makes this 
measurement both tedious and inaccurate. Consequently only the 
high-frequency approach was used. 

The noise-free output signal is measured by removing that input 
to the difference amplifier that comes from the delta modulator. 

4.4 Accuracy of the Measurements 

The tuned detector used to measure the noise in these experiments 
was a 37B transmission measuring set. It has a frequency window of 
about 400 Hz. Therefore, when the noise is measured at a particular 
frequency, a 400 Hz band is actually measured and the meter reading 
must be averaged, ignoring peaks. It is estimated that the readings are 
accurate to about ±0.5 dB. 

Another source of error arises in the determination of the normalized 
step size kF s . As mentioned above kF s can be found from direct meas- 
urement on an oscilloscope, or by using a square wave input that over- 
loads the system. A small error in this measurement is equivalent to 
a displacement in the noise curve (or signal-to-noise ratio) when 
plotted against kF s . The noise changes in the overload and granular 
regions about 1 dB for every dB change in kF s . Furthermore, the 
spectrum in overload also changes veiy rapidly with kF s . 

Therefore, it is fair to conclude that the experimental results in Section 
V are accurate to about ±1 dB. 

v. RESULTS 

5.1 Noise Loading Results — Uncorr elated Noise Component 

In Fig. 11 we have plotted the spectrum of the signal uncorrelated 
component of the noise as obtained by the noise loading test for three 
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Fig. 11 — A-mod uncorrelated noise spectrum, F, = 8. 
O kF, = 2 
LTJkF. = 8 
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values of kF s . For kF s = 8 and 16 notice that the noise spectrum is 
flat, as expected, since granular noise is predominant. When kF s = 2, 
overload noise is controlling, and the noise spectrum is largest at low 
frequencies. Agreement between the computer generated spectrum 
and the measured spectrum is good except where the granular noise is 
small. In this region, it is believed that round-off errors in the com- 
puter simulation account for the discrepancy. Integration of the noise 
spectrum yields the signal to noise curve of Fig. 12 plotted as a func- 
tion of kF„. 

5.2 Cancellation Technique — Total Noise 

Noise spectrum measurements obtained by the cancellation tech- 
nique are compared with computer results in Fig. 13. As before, for 
kF 8 = 8 and 16 the spectrum is flat and nearly identical in level with 
the noise loading results. When well into overload (kF s = 2), the total 
noise spectrum peaks at the high frequency end. This behavior is 
readily explained in terms of our equivalent linear system. Consider 
the difference e{t) between the input signal and the output of the 
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Fig. 12 — A-mod signal to uncorrelated noise ratio, F. = 8. 

equivalent linear system of Fig. 3 

e(0 = x{t) - y(t) = x{t) - n{t) - f g(t - t)x(t) dr (15) 



or 



>,{l) = f" [8(t - r) - g(t - t)]x(t) dr - n(t). 

J — (O 



(16) 



Since n(t) and x(t) are uncorrelated by definition, it is an easy mat- 
ter to show that the error spectrum of the total noise is 

SM = S nn (") + | 1 - G(jco) | 2 5«(co). (17) 

Substituting H(jo)), obtained by statistical linearization and given in 
equation (10) for the equivalent linear system function G(j<o) in equa- 
tion (17), we get 



£..(«) - &„(«) + 



2 

£ — 3 S„(a) 

1+^ 



(18) 



From either equation (17) or (18) we can see that when G(;'w) is es- 
sentially unity (in the granular region) that the total noise is given 
by S„„{o>). On the other hand, when well into overload, the low fre- 
quency portion of the total noise is determined by S„„(<o) and the 
noise at high frequencies increases due to the second term in equation 
(18), the term linearly dependent on the input. Indeed, we can use 
the measured noise spectrum in Fig. 13 for kF, = 2 along with equa- 
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Fig. 13 — A-mod error spectrum, cancellation technique, F, = 8. 
O kF. = 2 
DkF. = 8 
kF, = 16 
— computer results. 

tion (18) to determine the comer frequency for the equivalent linear 
system. The f so obtained is about 0.4 f b in agreement with the 
analysis. 

For completeness, we present in Fig. 14 the signal-to-total-noise 
ratio obtained by integrating the curves of Fig. 13. In addition, we 
have noted the corresponding analytical results obtained by using the 
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results of Refs. 9 and 10. Agreement is good except when far into the 
overload region where it is known that the mean square value of the 
total noise obtained analytically is a coarse upper bound. 
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APPENDIX A 

Statistical Linearization 

A.l General 

In this appendix we consider the delta modulation system under 
pure slope overload conditions. Our objective is to replace the hard 
limiter in the encoder loop with a linear amplifier. We give three 
methods for the determination of the gain in this linear approxima- 
tion. 

A.2 Conventional Statistical Linearization — Gaussian Assumption 

First, we use the statistical linearization method attributed to 
Booton. 18 We isolate the hard-limiter in Fig. 4 with input e(t) and 
output z[e(0] in order to replace it with an ideal linear amplifier of 
gain K cq . This gain factor is chosen such that K eq e{t) differs least in 
the mean square sense from z[e(t)]. It is readily shown the optimum 
K en satisfies 

K ' m " (e\ v { } 

For the hard limiter, under the assumption that e(t) is gaussian, we 
get the well known result 14 

K - - *-LkJ s K ' ■ (20) 

A.3 Removal of Gaussian Assumption 

In general, e(t) will not be gaussian; though this is commonly as- 
sumed in all references to the statistical linearization method. We 
remove this assumption in this section since we can determine both 
(ez) av and (e 2 ) av using the approach given in Ref. 9. Since (e 2 ) av was 
found in that reference, we need only consider (ez) av = R ez (0) . 
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Notice that when 

e(t) > 0, z(t) = xi | (21) 

and where fA ^ _ , A ,[ 

e(t) < 0, 2(0 = —x' ) 

Hence 

<«>„ = x' (\ e{t) \)„ = xi ave [e(t)\ | p . b . (22) 

that is, the average of e(0 over the positive bursts (p.b.) only of the 
slope overload noise. 

Following the procedure developed in Ref . 9, we obtain 

^i^i^fSH^I-f]*'' (23) 



where 



_ x' V2 
Xl 3(&0* 



(24) 



OfcO = 1 - (1 - xD exp (- f) - x ;*CcO 

0(xO = J exp ^- ^J dz 

b n = /"" «'-5„(«) <ff. 
In Ref. 9 it was found that 

where A ( x ) is given in equation (66) of Ref. 9. Hence 

A.4 Equivalent Gain from Definition of Equivalent Linear System 

Among the many other viewpoints that might be adopted to find 
K eq , we single out one that makes use of the definition of the equi- 
valent linear system given in the text. Recall that 

G(p}) = sm ~ x *„(«) (27) 
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or 

S. t (o>) = &,(«) - G(ja)S xx (<»)- (28) 

If we integrate equation (27) over ( — 2irf to +2ir/ ) and choose G(ju) = 
K 3 /K 3 + ja, we obtain the following equation defining K 3 . 



(x(t)e(t)\ v = RUO) = (At)).. ~ h f "' S " (a) a d 



(29) 



Noticing that S xx (a>) is an even function of w, using 

F(J) = 2S„(2tf) for / > 0, (30) 

and defining f = Kz/2-n, we get 

h(J.) = f° m * = (x\t))„ - (x(t)e(t)) BV . (31) 

■ i + (9 

The left side of equation (31) is a function of f e only, and hence of K 3 , 
while the right side of equation (30) is known; a formula for (x(l)e(t)) av 
has been found. 17 Equation (31) can be shown to always have a solution. 

A little reflection will convince the reader that equation (31) could 
have been obtained from scratch by preselecting the form of the equiva- 
lent linear system, and requiring that x(t) be uncorrected with n(t) 
at t = 0. The approach we have taken could be generalized to match 
various spectral moments of the processes under consideration. This 
would entail multiplying equation (28) by w 2n prior to integration and 
choosing the number of parameters in G(ja>) equal to the number of 
moments matched. In general a set of simultaneous nonlinear equations 
would have to be solved and quantities such as (d n x(t)/dt n e(t)) av obtained 
using the techniques of Ref. 9. Fortunately, no such generalization is 
required. As we see below and from Table I all of the techniques used in 
this Appendix give good agreement with computer simulation. 

Example: Application of equation (31) to flat band limited signals 

(x 2 ) av = l,/„ = 1 gives 
h <tt = f -4rv = f- tan_1 (f) = 1 - < xe >" • (32) 

Jo l + ^ 
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APPENDIX B 

Harmonic Response of a Delta Modulator with a Leaky Integrator 
Under Pure Slope Overload Conditions 

B.l Introduction 

Consider the single-integration delta modulator with a leaky in- 
tegrator under pure slope overload conditions. The problem is to find 
the steady-state response of this nonlinear system to a sinusoidal 
input. The analysis is applicable to differential pulse code modulation 
and delta modulation with a more complicated linear network in the 
feedback path. 

Consider a sinusoidal input signal : 

x(t) = X„ cos coj (33) 

with 

co = 2wf . (34) 

In the steady-state the output y(t) will be a periodic function of t 
with period 1/fo. The maximum value of the magnitude of the slope 
of the input sinusoidal signal is clearly equal to *> X so that if 

a,X„ < j (35) 



x' 
the output will follow the input and we will have 

y(t) = x(t) = X cos coj. (36) 

Suppose now that x' < co X . In this case slope overload occurs. 
Call <t> the value of coj — 2nw (where n is a positive integer) for which slope 
overload occurs for the first time after the beginning of the nth period. 
Assuming that we have reached the steady-state, the value of <f> will 
be the same for all periods. 

Clearly < <t> < r/2. The slope of the input signal at the transition 
point A (Fig. 15) will be negative and equal to — X o 0) sin 0. (The second 
derivative at A is also negative and equal to — X co 2 cos <f>.) 

For slope overload to begin at A we should have;f — o) X sin $ = — x' a , 
so that 



sin <p = 



0) X 



(37) 



t A similar analysis may be made in the asymmetric case, that is, when the 
positive overloading slope is not equal to the negative overloading slope. 
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At this transition point the output signal begins to follow an exponential 
curve such that 



1 — exp I —a 



y(t) = X cos — x Y 



oi t — <f> — n-K 



(38) 



as long as y(t) exceeds x(t). The exponential segment ends when 
y(t) and x(t) once again become equal as shown in Fig. 15. For small 
leak, the response in overload is clearly linear in time. As long as | 6 \ 
< <f> we have for all n 



y(D = 



X„ cos uj for + n-K ^ coj ^ <£ + nw 



1 — exp I —a 



(-l)"X o cos0 + (-l) n+ X 



co J — d> — ?lir 



for + rnr ^ caj ^ + (n^Kl)ir 



(39) 

It it easy to show that the region where equation (39) is tine may 
be translated to the condition 



(40) 




C0 t 



Fig. 15 — Slope overload for 

x < •** g A + -q 

xo' \ 4 

(leaky integrator). 
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In the limit when a goes to zero (no leak) equations (39) and (40) 
reduce to results obtained previously by Baikovskii. 16 The quantities 
6 and <f> coalesce when 



oX 



> 



i + 7 



1 — exp I 



air 



(41) 



and the output is made up of segments of an exponential curve as 
shown in Fig. 16. From Fig. 16 we see that 



cos <f> 



1 - ex p \r f 

2aX n 



(42) 



and for all n 



y(t) = (-l) n x' 



. , air 

1 — exp I — 

"2a" 



1 — exp 



— — (b) t — d> — mr) 

0)„ 



(43) 



Notice that in this case the magnitude of the output depends only 
on the frequency of the input sinusoidal waveform and not on its 
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Fig. 16 — Slope overload for 
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amplitude. Only the phase of y{t) depends on X . Clearly when the 
leak goes to zero (a = 0) the response is triangular. 

B.2 Harmonic Analysis of y(t) 

In all three regions above the output y(t) is a periodic function of 
t with period 2ir/^ n such that 

y(t + l) = -y(t). (44) 

Hence y(t) contains only odd harmonics; it is a straight-forward 
matter to compute the Fourier coefficients. The complex equivalent 
gain is given by the ratio of the coefficient of the fundamental in the 
output to X . We leave this manipulation to the interested reader 
and merely provide a curve of equivalent gain computed for the case 
of a perfect integrator (a = 0) , in Fig. 6. Experimental points on the 
curve are seen to be in close agreement with the analysis. 

appendix c 

Computational Formulas to Estimate Correlation Function and 

Spectra 

From the sample sequences x t and e* for signal and error pro- 
duced by the simulator, autocorrelation and cross-correlation functions 
fl e (j),2UJ),#* c +0'), and R xc -(j) were estimated as the arithmetic 
means of e m e m+) , x,„x m+j , e,„x m+j and e m x m - h respectively. In the com- 
putations, sample sequences of length 10,000 were used. Correlations 
were computed up to j = 30. It is easy to show that spectrum estimates 
may be obtained by using the correlation estimates as coefficients of 
a Fourier series. In the case of the cross spectrum, real and imaginary 
parts must be computed. For clarity, the formulas are listed below. 
Using the relationship derived in Section 2.1, the uncorrected noise 
spectrum may be estimated by: 

S n (]) = S.(j) - ^ ({Re [S Ie (j)]} 2 + {Im [S zt (j))} 2 )- (45) 

To smooth possible ripples in the spectrum estimates due to time 
truncation of the correlation functions, a hanning window function 
was used. 10 This smoothing amounts to replacing each spectrum 
estimate by a linear sum of the estimate and the two adjacent esti- 
mates, with weights }, 4, and ^. 
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Error spectrum: 

S,(j) = R.(Q) + 2 X! J8.(Q cos -^j + RXN ~ 1) cos jr. (46) 
Signal spectrum: 
8,(1) = R x (0) + 2 2 5,(0 cos rp^-r + B,(iV - 1) cos jr. (47) 



JV - 1 



Cross spectrum: 



Re {&.(/)} - fl,.(0) + E [««.+(*) + «..-<*)] C0S iv^T 



+ $[R xe+ (N - 1) + fl„_(tf - 1)] cos jir (48) 

N - 1 



Im [SJH) = E [R« + (Q - «,.-(«)] cos T^-r- (49) 
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